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ABSTRACT 



^€^ho4 g^gs^e^ng-andaiiserfing~advertise - 
cments-irr^n^ 
;\vlierein4he^ 

prognunjnmg.vie.wed-by^ systems and methods 

maybenmplementedlising the Internet or another informa- 
tion retrieval system that includes a client system and a 
remote server. The client system monitors television pro- 
gramming viewed by the user and compiles a user profile 
characterizing the television programming. When the user 
requests an Internet resource using the client system, the 
television programming information in the user profile is 
utilized to select an appropriate advertisement. The adver- 
tisement is then inserted in the information document and 
displayed to the user. Advertisement selection and insertion 
may be conducted at the remote server, the client system, or 
at the level of the Internet service provider. Such selection 
of advertisement increases the efficiency by which Internet 
advertisements are tailored to individuals. Instead of adver- 
tisements, information relating to the television program- 
ming may be retrieved over the Internet and displayed 
without direct user assistance. 
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SYSTEM AND METHOD OF INSERTING 
ADVERTISEMENTS INTO AN INFORMATION 
RETRIEVAL SYSTEM DISPLAY 

BACKGROUND OF THE INVENTION 

[0001] 1. The Field of the Invention 

[0002] The present invention relates to advertising on an 
information retrieval system. In particular, the present 
invention relates to systems and methods of selecting adver- 
tisements and displaying the selected advertisements on an 
information retrieval system based at least in part on the 
television viewing habits of the recipient of the advertise- 
ments. 

[0003] 2. The Prior State of the Art 

[0004] The Internet, and particularly the World Wide Web 
("Web''), has experienced tremendous growth during recent 
years. The Web allows users to retrieve and access text, 
graphics, audio, video, and other information from remote 
servers. The Web has become a valuable source of news, 
educational resources, commercial information, entertain- 
ment, and the like. Many, if not most, Web sites are 
accessible by users free of charge. Other sites are made 
available to users for a small fee. Many Web sites subsidize 
part or all of the cost of maintaining a server, posting 
information in Web pages, etc. by selling and distributing 
advertisements embedded in Web pages. 

[0005] As in other advertising applications, it has been 
found that advertisements in Web pages are most effective if 
they can be tailored and directed to segments of the popu- 
lation that are likely to be interested in the advertised goods 
and services. Because of the interactive nature of the Internet 
and the ability to easily insert graphical images in Web 
pages, there have been developed several methods of tar- 
geting Internet advertisements to specific users or specific 
groups of users. 

[0006] One of the simplest methods of tailoring Internet 
advertisements to recipients is similar to techniques used in 
television, radio and other media. In particular, advertise- 
ments are selected to correspond to the subject matter of the 
Web page or other Internet resource. It is assumed that users 
who actively retrieve Internet resources dealing with a 
certain topic are more likely than the population at large to 
be receptive to advertisements directed to the topic. For 
example, if a Web site relates to travel information, adver- 
tisers and Web site providers can generally assume that users 
accessing the Web site will have a heightened interest in 
travel-related advertisements. 

[0007] Advertisements are particularly attractive in the 
Internet environment for several additional reasons. First, 
Internet users are typically actively and attentively taking in 
information when they access Internet resources. Such users 
may be more receptive to messages delivered by advertisers 
than persons engaged in other activities. Second, because of 
the interactive nature of the Internet, recipients of advertis- 
ing may choose to receive a small amount or a relatively 
large amount of information on the advertised goods or 
services. For example, a typical Internet advertisement may 
consist of a banner box or another graphical image identi- 
fying the goods or services or presenting a concise adver- 
tising message. Moreover, the graphical image is frequently 
an active link that may be selected by the user in order to 



access a Web site specifically dedicated to the advertised 
goods or services. Accordingly, interested recipients may 
easily retrieve additional information relating to advertiser's 
message, while disinterested recipients are not inconve- 
nienced by too much unwanted information. The multimedia 
aspect of the Internet also allows advertisers to present their 
messages in new and interesting ways. 

[0008] In addition to basing advertisement selection on the 
subject matter of Web sites, advertisers have also been able 
to learn of some preferences and habits of recipients in order 
to more effectively tailor advertisements. Many Web sites 
download "cookies" to users' computers when users access 
the Web sites. Cookies are files installed and stored on the 
hard disk of client computers and are used to report infor- 
mation relating to the client computer to Web site content 
providers. In one example, a cookie may merely be an 
identifier that transmits a user password or other identifying 
information each time the user returns to the Web site, 
thereby eliminating the need for the user to remember and 
enter the password. In another example, however, cookies 
can be used to track and report the user's Internet habits, 
giving content providers and advertisers insight into the 
possible interests of the user, and allowing advertisements to 
be tailored accordingly. 

[0009] Services that automatically provide news and other 
information to recipients over the Internet have also become 
common. For example, there are many e-mail services and 
other Internet-based systems that periodically send mes- 
sages or other information documents relating to specific 
topics to interested persons. Generally, such services provide 
information to recipients who have placed their names in a 
subscriber list. There is typically no attempt to individually 
tailor the information sent to the subscribers based on the 
subscribers' particular preferences other than perhaps an 
interest survey submitted by the subscribers. 

[0010] In view of the foregoing, advertising techniques 
adapted from other media have been widely used to tailor 
advertisements to broad segments of the Internet-using 
population. Furthermore, interactive techniques, such as 
those involving "cookies", allow advertisers to learn of 
some of the recipient's habits as they relate to browsing 
Internet and otherwise using the recipient's computer. While 
such information increases the efficiency by which adver- 
tisers may target specific recipients, any further source of 
information relating to individual habits and preferences 
would be a valuable improvement in the Internet advertising 
industry. 

[0011] From the standpoint of the advertiser, any increase 
in the ability to narrowly target recipients would make 
advertising on the Internet more attractive. Internet content 
providers would also favor advancements in advertising 
effectiveness, since they would then collect more advertising 
fees from advertisers. Finally, the Internet-using public 
benefits from being more effectively targeted in at least two 
ways. First, advertising recipients would be more likely to 
receive advertising information that is of interest and value. 
Second, a greater number and variety of Internet sites are 
likely to be profitable using improved advertising tech- 
niques, thereby making more no-cost and low-cost Internet 
sites available to the public. 
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ti sejng gts^al^^isin^^ 
displasygSCT^ 
k^stfitorjiwtp^ 

Q'femc < a£v6rtJsWcQts.,F^r example, the information retrieval 
system may be the Internet, with the advertisements being 
embedded and displayed in a Web page or another Internet 
resource. Monitoring the television viewing habits of the 
recipient allows the advertisements to be more effectively 
tailored to the specific habits and preferences of the recipi- 
ent. 

[0013] The invention may be im plemented in an informa- 
tion retrieval system igelufflffg^cli 

sewer-CQringured^to-izdmmunicate one__with another. In 
Internet implementations, an Internet service provider 
("ISP 1 ') may also be present in order to facilitate and route 
information transmission over the system. Moreover, the 
client terminal is connected to, associated with, or otherwise 
has access to a television set or a television programming 
feed. According to the invention, the client terminal moni- 
tors television programming viewed by the user, and 
includes the television viewing habits in a user profile. 

[0014] When the user requests an information document, 
such as a Web page, from a remote server, the user profile 
is used in conjunction with selection criteria to select an 
advertisement appropriate for the user. Data representing the 
selected advertisement is inserted into the information docu- 
ment, and when the information document is displayed to 
the user, the selected advertisement is also displayed. The 
process of selecting and inserting the advertisement may be 
conducted according to any of at least three methods^In^ 

: c6nducted^at ^e,client^m^ter v attthe server computer r ahd 
Mri4ntemeJ^ Moreover, selection 

and insertion may be conducted at any combination of the 

foregoing sites. 

[0015] The foregoing methods of advertisement selection 
and insertion more generally extend to selection and display 
of any type of information to a recipient based at least in part 
on television viewing habits. As described herein, the client 
terminal monitors television programming viewed by the 
user and compiles a user profile. The user profile is com- 
pared against a list of information categories, which may be 
standard or user-defined. One or more of the information 
categories that correspond to the user profile are then used 
to request information documents from the server computer. 
For example, the invention may be implemented in an 
Internet news delivery service wherein the information 
categories correspond to particular categories of news sto- 
ries. Accordingly, information such as news, entertainment, 
educational resources, and the like, may be selected based at 
least in part on the television viewing habits of the recipient, 
automatically retrieved, and made available to the recipient. 

[0016] In view of the foregoing, the invention disclosed 
herein provides methods and systems for tailoring adver- 
tisements and other information to specific recipients in 
ways that have not previously been possible. Monitoring the 
television viewing habits of recipients allows advertisers and 
content providers to gain valuable insight to the preferences 
of the users. Accordingly, the advertisements or other 



selected information is more likely to be relevant and of 
interest to the recipient using the invention than using 
conventional methods. 

[0017] Additional objects and advantages of the invention 
will be set forth in the description which follows, and in part 
will be obvious from the description, or may be learned by 
the practice of the invention. The objects and advantages of 
the invention may be realized and obtained by means of the 
instruments and combinations particularly pointed out in the 
appended claims. These and other objects and features of the 
present invention will become more fully apparent from the 
following description and appended claims, or may be 
learned by the practice of the invention as set forth herein- 
after. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0018] In order that the manner in which the above-recited 
and other advantages and objects of the invention are 
obtained, a more particular description of the invention 
briefly described above will be rendered by reference to 
specific embodiments thereof which are illustrated in the 
appended drawings. Understanding that these drawings 
depict only typical embodiments of the invention and are not 
therefore to be considered limiting of its scope, the invention 
will be described and explained with additional specificity 
and detail through the use of the accompanying drawings in 
which: 

[0019] FIG. 1 is a schematic diagram illustrating a net- 
work system in which the invention may be implemented, 
wherein the network system includes client terminals, serv- 
ers, and a television programming source. 

[0020] FIG. 2 is a schematic diagram of one embodiment 
of a client system for use with the invention. 

[0021] FIG. 3A is a schematic diagram depicting a first 
embodiment of the systems and methods of the invention, 
wherein an advertisement is selected and inserted into an 
information document at the server computer. 

[0022] FIG. 3B is schematic diagram showing a second 
embodiment of the systems and methods of the invention, 
wherein an advertisement is selected and inserted into an 
information document at the level of the Internet service 
provider. 

[0023] FIG. 3C is a schematic diagram illustrating a third 
embodiment of the systems and methods of the invention, 
wherein an advertisement is selected and inserted into an 
information document at the client system. 

[0024] FIG. 4 is a flow diagram depicting selected steps of 
the methods associated with FIGS. 3A-3C. 

[0025] FIG. 5 is a schematic diagram showing a further 
embodiment of the systems and methods of the invention, 
wherein information classified under specified categories is 
selected, retrieved, and displayed based at least in part on the 
television viewing habits of the recipient. 

[0026] FIG. 6 is a schematic diagram further illustrating a 
television monitoring module and associated elements of the 
systems of the invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 
[0027] The present invention relates to selecting and dis- 
playing advertisements or other information on a display 
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device of an information retrieval system based at least in 
part on the television viewing habits of the recipient. A client 
terminal or the like monitors the television viewing habits of 
the recipient, which are included in a user profile. The user 
profile, in combination with selection criteria, may be used 
to select advertisements for display to the recipient. When 
the recipient requests an information document using the 
information retrieval system or when an information docu- 
ment is otherwise delivered to the client terminal, the 
selected advertisement is inserted into the information docu- 
ment and is displayed to the recipient. 

[0028] The invention is described below by using dia- 
grams to illustrate either the structure or processing of 
embodiments used to implement the system and method of 
the present invention. Using the diagrams in this manner to 
present the invention should not be construed as limiting of 
its scope. The embodiments of the present invention may 
comprise a special purpose or general purpose computer 
including various computer hardware, as discussed in 
greater detail below. The embodiments may further com- 
prise multiple computers linked in a network environment. 

[0029] Embodiments within the scope of the present 
invention include computer readable media having com- 
puter-executable instructions or data fields stored thereon. 
Such computer readable media can be any available media 
which can be accessed by a general purpose or special 
purpose computer. By way of example, and not limitation, 
such computer readable media can comprise RAM, ROM, 
EEPROM, CD-ROM or other optical disk storage, magnetic 
disk storage or other magnetic storage devices, or any other 
medium which can be used to store the desired computer- 
executable instructions or data fields and which can accessed 
by a general purpose or special purpose computer. Combi- 
nations of the above should also be included within the 
scope of computer readable media. Computer-executable 
instructions comprise, for example, instructions and data 
which cause a general purpose computer, special purpose 
computer, or special purpose processing device to perform a 
certain function or group of functions. The computer-ex- 
ecutable instructions and associated data fields represent an 
example of program code means for executing the steps of 
the invention disclosed herein. 

[0030] FIGS. 1 and 2 and the following discussion are 
intended to provide a brief, general description of a suitable 
network and computing environment in which the invention 
may be implemented. Although not required, the invention 
will be described in the general context of computer-execut- 
able instructions, such as program modules, being executed 
by a personal computer. Generally, program modules 
include routines, programs, objects, components, data struc- 
tures, etc. that perform particular tasks or implement par- 
ticular abstract data types. The invention will also be 
described by making reference to information documents, 
which generally include or are defined by encoded data 
structures stored in a computer-readable medium or a com- 
puter memory device. The encoded data structures of docu- 
ments typically represent text, graphical images, audio, or 
other information that may be communicated to a user, and 
generally may be generated, edited, displayed and/or stored 
using a computer. The information documents may be Web 
pages or other Internet resources. 

[0031] For illustration purposes, the invention is described 
herein in reference to the Internet, which represents one 



example of information retrieval systems that are compatible 
with the invention. However, the principles disclosed herein 
are also applicable to other information retrieval systems. 
Accordingly, it is to be understood that the invention is not 
to be limited to the Internet. Those skilled in the art will 
understand how to implement the invention in other infor- 
mation retrieval systems upon learning of the information 
disclosed herein. 

[0032] FIG. 1 illustrates one embodiment of the architec- 
ture of an information retrieval system in which the inven- 
tion may be implemented. In this embodiment, multiple 
clients systems 10 communicate with a modem pool 12 by 
means of direct-dial, bi-directional data connections 14, 
which may be conventional telephone lines, ISDN connec- 
tions, connections supported by cable television providers, 
or any other suitable communications channel. Modem pool 
12 may be any conventional modem pool, such as those that 
are currently used for providing access to the Internet and 
other wide area networks. For example, modem pool 14 may 
be provided by a local ISP. Thus, modem pool 14 may be 
coupled to a number of server computers, such as remote 
servers 16, via a conventional network infrastructure, which 
may be Internet infrastructure 18. 

[0033] FIG. 1 further illustrates an example of combining 
information retrieval over the Internet with television view- 
ing. At least some of client systems 10 are associated with 
display devices 20 that serve a dual function. First, display 
devices 20 display graphical, computer-generated or com- 
puter-transmitted information provided by client systems 10. 
Web pages retrieved from remote servers 16 represent one 
example of the graphical information that may be displayed 
on display devices 20. Second, television programming 
transmitted from television programming source 22 may 
also be displayed on display devices 20. Television pro- 
gramming source 22 may be any desired television broad- 
caster or delivery system. Accordingly, display device 20 
may be a conventional television or may instead be a 
computer monitor adapted to display television program- 
ming. Indeed, the client system is optionally integrated in a 
television, or instead may be a self-contained unit. The 
invention extends to systems incorporating the information 
retrieval systems disclosed herein in combination with a 
home entertainment system including a television or another 
display device 20. It is also noted that client terminal 24 is 
defined herein to include the client system and the display 
device. 

[0034] FIG. 2 depicts selected elements of one embodi- 
ment of a client system that may be used to implements 
portions of the invention. Client system 10 uses hardware 
and computer-executable instructions for providing the user 
with a graphical user interface, by which the user can access 
Internet resources, send and receive e-mail, and optionally 
receive other information services. Operation of client sys- 
tem 10 is controlled by a central processing unit (CPU) 26, 
which is coupled to an application-specific integrated circuit 
(ASIC) 28. CPU 26 executes computer-executable instruc- 
tions designed to implement features of client system 10, 
including some of the steps of methods of the present 
invention. ASIC 28 contains circuitry which is used to 
implement certain functions of client system 10. c20 For 
example, ASIC 28 may be coupled to an audio digital-to- 
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analog converter 30 and to a video encoder 32, which 
provide audio and video output, respectively, to display 
device 20 of FIG. 1. 

[0035] Client system 10 may further include an IR inter- 
face 34 for detecting infrared signals transmitted by a remote 
control input device, such as a hand-held device or a 
wireless keyboard. In response to the infrared signals, IR 
interface 34 provides corresponding electrical signals to 
ASIC 28. Alternatively, the signals transmitted by remote 
control device 14 may be selected from another suitable 
region of the spectrum. A standard telephone modem 36 and 
an ISDN modem 38 are coupled to ASIC 28 to provide 
connections to modem pool 12 and, via the Internet 18, to 
remote servers 16. While the client system illustrated in 
FIG. 2 includes both a telephone modem and an ISDN 
modem, either one of these devices is sufficient to support 
the communications of the client system. Furthermore, in 
other embodiments, modems 36 and 38 may be supple- 
mented or replaced with cable modem 40 or another suitable 
communications device. In other environments, communi- 
cation may instead be established using a token ring or 
Ethernet connection. 

[0036] Also coupled to ASIC 28 are a mask read-only 
memory (ROM) 42, a flash memory 44, and a random access 
memory (RAM) 46. Mask ROM 42 is non-programmable 
and provides storage of computer-executable instructions 
and data structures. Flash memory 44 may be a conventional 
flash memory device that can be programmed and erased 
electronically. Flash memory 44 may store Internet browser 
software as well as data structures. In one embodiment, a 
mass storage device 48 coupled to ASIC 28 is included in 
client system 10. Mass storage device 48 may be used to 
supply computer-executable instructions and data structures 
to other components of the client system or to receive data 
downloaded over the network. Mass storage device 48 may 
include any suitable medium for storing computer-execut- 
able instructions, such as magnetic disks, optical disks, and 
the like. 

[0037] Application software and associated operating sys- 
tem software are stored in flash memory 44, or instead may 
be stored in any other suitable memory device, such as mask 
ROM 42 or mass storage device 48. The computer-execut- 
able instructions that, according to one embodiment of the 
invention, are used to monitor television viewing habits of 
a user and to construct a user profile that forms at least part 
of the basis for selecting advertisements are executed by 
CPU 26. In particular, CPU 26 executes sequences of 
instructions contained in one or more of mask ROM 42, 
flash memory 44, and RAM 46 to perform certain steps of 
the present invention that will be more specifically disclosed 
hereinafter. 

[0038] In one embodiment of the invention, client system 
10 is a WebTV client box manufactured by WebTV Net- 
works, Inc. of Palo Alto, Calif. One reason that WebTV 
client boxes may be conveniently used with the invention is 
that they include television interface features that combine 
Internet browsing with television viewing. For example, the 
display device that is typically used to graphically display 
Web resources retrieved by a WebTV system is a conven- 
tional television. Furthermore, WebTV client boxes may be 
adapted to monitor television viewing habits as further 
disclosed herein. Alternatively, client system 10 may be any 



of a variety of systems for providing access to the Internet 
or other information retrieval systems. When a WebTV 
client box is used as client system 10, the network archi- 
tecture illustrated in FIG. 1 may further include a dedicated 
server 50, which is dedicated to providing information 
specifically to WebTV clients boxes. 

[0039] The elements of client system 10 are not limited to 
those depicted in FIG. 2. For example, the invention may be 
used with other computer system configurations, including 
personal computers, hand held devices, multiprocessor sys- 
tems, microprocessor-based or programmable consumer 
electronics, network PCs, minicomputers, mainframe com- 
puters, and the like. The invention may also be practiced in 
distributed computing environments other than the network 
environment of FIG. 1. For example, the invention may be 
used in any suitable network environment where tasks are 
performed by remote processing devices that are linked 
through a communications network. 

[0040] FIGS. 3A-3C illustrate three embodiments of the 
invention, wherein advertisements are selected and inserted 
into an information document based at least in part on 
television viewing habits of the recipient In general, the 
embodiments of FIGS. 3A-3C are configured to monitor the 
television viewing habit of a user of the client system and to 
construct a user profile that includes the television viewing 
habits. Based at least in part on the television viewing habits, 
an appropriate advertisement is selected according to adver- 
tisement selection criteria. The selected advertisement is 
inserted into an Internet document and is displayed to the 
user on the display device. Advertisement selection and 
insertion is conducted at the remote server in FIG. 3A and 
at the Internet service provider and the client system in 
FIGS. 3B and 3C, respectively. 

[0041] Turning now to FIG. 3 A, television programming 
source 22 broadcasts a television programming feed that is 
displayed to the user on display device 20. A television 
monitoring module 52 at client system 10 has access to the 
television programming feed and detects the identity or the 
content of the television programming used by the user. A 
more detailed description of one embodiment of a television 
monitoring module is disclosed herein in reference to FIG. 
6. 

[0042] A user profile 54 compiled at client system 10 is a 
profile of the user of the client system 10 and includes at 
least information relating to the television programming 
displayed on display device 20. User profile 54 may also 
include other user information further characterizing the 
user. Examples of such user information include demo- 
graphic information, Internet usage data, geographical infor- 
mation, or other identifying information. U.S. patent appli- 
cation Ser. No. 09/094,851, filed on Jun. 15, 1998, discloses 
user profiles and specific example of user information, many 
of which may be included in the user profiles of the present 
invention. For purposes of disclosure, the foregoing patent 
application is hereby incorporated by reference. 

[0043] The information included in user profile 54 may be 
compiled over any desired period of time. For example, user 
profile 54 may be updated each time the user views a 
television program. Information relating to viewed televi- 
sion programming may be retained in user profile 54 for a set 
period of time. According to one option, the most recently 
viewed television programming is given more weight in user 
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profile 54 than older programming. Alternatively, user pro- 
file may include information relating to only the most 
recently viewed television programming. 

[0044] Client system 10 provides Internet access to the 
user by means of an Internet browser 56, which may be any 
conventional or other Internet browser that is adapted or 
otherwise capable of transmitting information included in 
user profile 54 as further described herein. For example, 
when client system 10 is a WebTV client box, Internet 
browser 56 is the Internet browser typically included in 
WebTV client boxes, with the browser being adapted to 
transmit user profile information. The Internet browser 54 
included in client system 10 is one example of means for 
requesting an information document from a server computer. 

[0045] A user enters commands to client system using 
input device 58, thereby requesting an information docu- 
ment from remote server 16. When client system 10 is a 
WebTV client box, input device 58 may be a handheld 
remote control device or a wireless keyboard that allows the 
user to select and retrieve desired Internet resources. Alter- 
natively, the input device may be a keyboard, a mouse, or 
another device that is conventionally used to provide user 
input to an Internet browser. It is noted that a user may 
access the Internet by means of the Internet browser 56 at 
any time after having viewed television programming on 
display device 20. For example, the user may interrupt 
television viewing to access the Internet or, alternatively, 
may access the Internet some time after having stopped 
watching television programming. 

[0046] The Internet browser sends a uniform resource 
locator (URL) via Internet service provider 60 to a document 
retrieval module 62 at remote server 16, For example, the 
network architecture by which client system 10 communi- 
cates with remote server 16 may be that disclosed in FIG. 
1. Methods and systems for retrieving an information docu- 
ment over the Internet or other information retrieval systems 
are well known in the art. In the embodiment of FIG. 3A, 
wherein advertisement selection and insertion into the infor- 
mation document is conducted at remote server 16, client 
system 10 farther sends information from user profile 54 to 
an advertisement selection decision unit 64 at remote server 
16. As previously noted, the information user profile 54 
identifies the television viewing habits of the user of client 
system 10. 

[0047] In this embodiment, remote server 16 includes 
features for providing a plurality of advertisements and for 
selecting and inserting an advertisement into the requested 
information document. In one implementation, an advertise- 
ment source 66 supplies a plurality of advertisements that 
are stored in advertisement repository 68. In one embodi- 
ment, advertisement source 66 and remote server 16 may be 
operated by the same party. Alternatively, advertisement 
source 66 may be operated independently from remote 
server 16 and located at a remote site. The plurality of 
advertisements provided by advertisement source 66 may be 
associated with a wide variety of advertisers and goods and 
services. 

[0048] In this embodiment, remote server 16 further 
includes advertisement selection criteria 70, which, in con- 
junction with the user profile information, govern the selec- 
tion of an advertisement stored in advertisement repository 
68. For example, the selection criteria may provide that an 



advertisement whose subject matter corresponds to the tele- 
vision viewing habits of the user is to be selected. Option- 
ally, advertisement selection criteria 70 further incorporates 
any of the conventional techniques for selecting advertise- 
ments, including selecting an advertisement to correspond to 
the subject matter of the requested information document. 

[0049] Remote server 16 retrieves requested information 
document 72 from a document cache 74 according to 
methods that will be understood by those skilled in the art. 
The information document 72 may be provided by a content 
provider who is also the operator of remote server 16. 
Alternatively, the content provider who provides informa- 
tion document 72 may be an entity that purchases informa- 
tion document posting services from the operator of remote 
server 16. Information document 72 may be any Internet 
resource or another computer-display able or computer- 
transmitted data structure. For example, Hyper-Text Markup 
Language documents ("HTML documents") are commonly 
retrieved over the Internet and are particularly suited for use 
with the invention. 

[0050] An advertisement insertion module 76 inserts data 
representing selected advertisement 78 into information 
document 72 after it is retrieved. For example, the selected 
advertisement may be embedded in the information docu- 
ment 72 according to conventional techniques. After the 
selected advertisement is inserted, the requested information 
document 72 is transmitted from remote server 16 to client 
system 10. Internet browser 56 displays the information 
document 72 and the selected advertisement 78 on display 
device 20, which is one example of means for displaying the 
information document. In this manner, the user of the client 
system views an advertisement that is determined to be 
appropriate based at least in part on the television viewing 
habits of the user. Selecting and inserting the advertisement 
at the remote server is advantageously compatible with 
current techniques of advertisement insertion, which are also 
conducted at the remote server. 

[0051] FIG. 3B illustrates an embodiment of the invention 
wherein advertisement selection and insertion are conducted 
at the level of the Internet service provider. Television 
programming is viewed by the user and a user profile 154 is 
compiled at client system 110 in much the same way as 
described herein in reference to FIG. 3A. When a user 
requests an information document from a remote server 
according to this embodiment, the URL is transmitted to the 
remote server via a request router 80 at the Internet service 
provider 160. The user profile, however, is transmitted to 
and stored at Internet service provider 160. Information from 
user profile 154 may be transmitted each time the user 
requests resources from the Internet, at the beginning of each 
Internet session that is served by Internet service provider 
160, or periodically at any desired interval. For example, 
client system 110 may update user profile copy 154' on a 
daily basis, regardless of whether the user has accessed the 
Internet during the day. Furthermore, Internet service pro- 
vider 160 may maintain user profile information associated 
with a plurality of client systems. The method of selecting 
advertisements at Internet service provider 160 may be 
substantially similar to the methods for selecting advertise- 
ments at remote server 16 described in reference to FIG. 3 A. 
Alternatively, advertisement selection decision unit 164 may 
select appropriate advertisements for client system 110 and 
compile a list of appropriate advertisements before any 
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information document is requested by client system 110. In 
this case, the preselected advertisements are already identi- 
fied and available for insertion into requested information 
documents when the user begins to access to the Internet. 

[0052] Advertisement insertion module 176 of FIG. 3B 
may insert the selected advertisement into the requested 
information document according to one of at least two 
methods. First, the information document transmitted from 
remote server 116 to Internet service provider 160 may 
include a vacant field or anther location to which the selected 
advertisement may be added. Second, advertisement inser- 
tion module 176 may overwrite an advertisement already 
included in the requested information document, thereby 
replacing the existing advertisement with the selected adver- 
tisement. 

[0053] The requested information document, including the 
selected advertisement, is next transmitted from Internet 
service provider 160 to the Internet browser 156 at client 
system 110. The information document and the selected 
advertisement may be displayed at display device 120 
according to the methods disclosed in reference to FIG. 3A. 
According to the embodiment of FIG. 3B, the user receives 
advertisements selected based at least in part on the televi- 
sion viewing habits of the user. Selecting and inserting the 
advertisements at the level of the Internet service provider 
have the advantage of allowing a periodically updated copy 
of the user profile to be stored at the Internet service 
provider. Accordingly, the Internet service provider may 
preselect advertisements for the users of a plurality of client 
systems. 

[0054] FIG. 3C illustrates a further embodiment of the 
invention, wherein advertisements are selected and inserted 
at the client system. The methods and systems for viewing 
television programming, monitoring the television program- 
ming, and compiling a user profile may be substantially 
similar to those disclosed in reference to FIGS. 3A and 3B. 
In this embodiment, however, the advertisement selection 
decision unit 264, the advertisement repository 268, and the 
advertisement selection criteria 270 are located at the client 
system 210. The user requests an information document 
from remote server 216 via Internet service provider 260 
according to methods that may be similar to those disclosed 
in reference to FIGS. 3A and 3B, with the exception that 
user profile information does not need to be transmitted from 
client system 210. In particular, a selected advertisement 
278, which may be identified before the user requests any 
Internet resources from the remote server, may be inserted 
into retrieved information document by Internet browser 
256. 

[0055] As described in reference to FIG. 3B, selected 
advertisement 278 can be inserted into the information 
document at a vacant field, or instead may replace an 
advertisement already included in information document. 
The information document with the selected advertisement 
embedded therein is then displayed to the user on display 
device 220 according to the methods disclosed herein. 
According to this embodiment, the advertisements are 
selected and inserted without transmitting any information 
relating to television viewing habits from client system 210. 
Because the Internet service provider and the remote server 
do not have access to the television viewing habits of the 
user, the privacy of the user with respect to television habits 
is maintained. 



[0056] FIG. 4 is a flow chart depicting selected steps of 
the methods associated with FIGS. 3A-3C. In step 410, the 
user views television programming, and the subject matter 
of the television programming is monitored at the client 
system. In step 412, the user profile, including information 
relating to the television viewing habits of the user, is 
compiled at the client system. The user requests an infor- 
mation document, such as a Web page, using an Internet 
browser at the client system as illustrated by step 414, In step 
416, an advertisement determined to be appropriate based at 
least in part on the user profile is selected for insertion into 
the requested information document. The selected advertise- 
ment is then inserted in step 418 into the information 
document. Steps 416 and 418 may be conducted at the 
remote server, the Internet service provider, or the client 
system as disclosed in reference to FIGS. 3A-3C. Finally, 
the requested information document, including a selected 
advertisement, is displayed to the user according to step 420. 

[0057] FIG. 5 illustrates a further embodiment of the 
invention, wherein any type of information may be selected 
and displayed to a user based at least in part on the television 
viewing habits of the user. For example, the information 
displayed to the user may be news, educational resources, 
advertising, entertainment, or any other desired type of 
information. In one implementation, the information 
retrieval system automatically provides and displays refer- 
ence information relating to the content of the television 
programming viewed by the user. For example, the reference 
information may include reviews, information about the 
cast, and other items of interest to television viewers. 

[0058] According to the embodiment of FIG. 5, a televi- 
sion programming source 322 provides a television pro- 
gramming feed to display screen 320 according to methods 
described in reference to FIGS. 3A-3C. Furthermore, tele- 
vision monitoring module 352 detects the identity or content 
of the television programming viewed by the user and stores 
information relating thereto in programming information 
repository 382. For example, the programming information 
may identify one or more topics associated with the televi- 
sion programming. In this embodiment, client system 310 
further includes a list of information categories 388, each 
being associated with information documents stored in a 
document cache 374 at remote server 316. A category 
selection module 384 compares the programming informa- 
tion with the information categories to select at least one 
information category 386 that corresponds to the television 
programming viewed by the user. The comparison of the 
programming information with the information categories 
388 may be facilitated by selection criteria similar to the 
advertisement selection criteria disclosed in reference to 
FIGS. 3A-3C. By way of example, and not by limitation, the 
selection criteria may provide that a selected information 
category 386 is identified by looking for a direct match 
between a keyword in the programming information and a 
keyword in information categories 388. 

[0059] When selected category 386 is identified, Internet 
browser 356 transmits a request to remote server 316 via 
Internet service provider 360 for one or more information 
documents associated with the selected category. Document 
retrieval module 326 then retrieves one or more information 
documents from document cache 374. These information 
documents are then downloaded to Internet browser 356 and 
displayed on display device 320. According to one option, 
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the information document may be displayed on display 
device 320 simultaneously with the television programming. 
For example, the information document may be overlaid on 
a selected region of the display device 320 or the display 
device may be divided into a split-screen arrangement. 
According to another option, the information documents are 
displayed on display device 320 only when the television 
programming feed to display device 320 is terminated or 
when the user affirmatively indicates that it is appropriate to 
display the information documents. 

[0060] Information categories 388 may be further tailored 
or narrowed to correspond to the viewing habits of the 
particular user, periodically updated from a remote source 
such as remote server 316, or selected by the user. For 
example, if it is noted that a user repeatedly views television 
programming related to sports, the information categories 
can be supplemented with subcategories relating to more 
narrow sports topics. One method of further tailoring infor- 
mation categories 388 to correspond to frequently viewed 
topics involves using a user profile similar to those described 
in reference to FIGS. 3A-3C. For example, a user profile 
indicating that the user frequently views particular sporting 
events may be used to retrieve subcategories from a remote 
server, which then can supplement the standard information 
categories 388. Direct user input may also be used to select 
or further refine information categories 388. This may be 
accomplished by providing a large list of information cat- 
egories from which the user may pick and choose to identify 
the categories that are likely to be of most interest. 

[0061] According to this embodiment of the invention, 
retrieval of news, entertainment, educational resources, or 
other information documents based at least in part on the 
television viewing habits of the user can be conducted 
automatically, with no user assistance. Such techniques 
provide automatic access to information that is likely to be 
of use and of interest to the recipient. 

[0062] FIG. 6 illustrates one example of a television 
monitoring module that may be used with the various 
embodiments of the invention. In this example, television 
programming source 22 broadcasts closed-captioning infor- 
mation 90 in addition to standard programming 92. Closed- 
captioning information 90 is routed to a closed-captioned 
monitoring unit 94, which detects keywords or otherwise 
determines the subject matter of the television programming 
92 based on the closed-captioning information 90. 

[0063] Additionally, television monitoring module 52 
accesses an electronic programming database ("EPD") 96 
that includes written or encoded descriptions of the subject 
matter of television programming 92. Based on the infor- 
mation from electronic database 96, EPD monitoring unit 98 
determines the subject matter of programming 92. Closed- 
captioning monitoring unit 94 and EPD monitoring unit 98 
update user profile 54 with the identified subject matter of 
the programming 92. For example, television monitoring 
module 52 may have access to a plurality of programming 
categories similar to information categories 388 of FIG. 5. 
In this case, EPD monitoring unit 98 and closed-captioned 
monitoring unit 94 identify one or more programming 
categories 100 that best correspond to the subject matter of 
programming 92 and cause these programming categories to 
be included in user profile 54. For illustration purposes, 
FIG. 6 shows television monitoring module 52 as including 



a closed captioning monitoring unit 94 and an EPD moni- 
toring unit 98, both of which are examples of means for 
monitoring the television programming viewed by the user. 
However, in many instances, only one of the foregoing 
monitoring units is sufficient to identify the content of the 
television programming. Furthermore, the invention is not 
limited to monitoring the content of television programming 
using closed captioning information or an electronic pro- 
gramming database, but may utilize other means for moni- 
toring the television programming. It is also noted that either 
of the closed captioning monitoring unit or the EPD moni- 
toring unit 98 in combination with programming categories 
100 represent but one example of means for compiling a user 
profile. 

[0064] The present invention may be embodied in other 
specific forms without departing from its spirit or other 
essential characteristics. The described embodiments are to 
be considered in all respects only as illustrative and not 
restrictive. The scope of the invention is, therefore, indicated 
by the appended claims rather than by the foregoing descrip- 
tion. All changes which come within the range of equiva- 
lency of the claims are to be embraced within their scope. 

What is claimed and desired to be secured by United States 
Letters Patent is: 

1. In an information retrieval system including a server 
computer and a client system having a display device, 
wherein the client system has access to television program- 
ming viewed by a user of the information retrieval system, 
a method for inserting an advertisement into a document 
displayed on the display device, the method comprising the 
steps of: 

compiling a profile of the user of the information retrieval 
system, including at least information associated with 
the television programming viewed by the user; 

requesting, by the client system, an information document 
from the server computer; 

selecting, based at least in part on the profile and on 
designated selection criteria, an advertisement from 
among a plurality of advertisements for insertion into 
the information document; 

inserting data representing the selected advertisement into 
the information document; and 

displaying the information document, including the 
selected advertisement, on the display device. 

2. A method as defined in claim 1, wherein the step of 
inserting data representing the selected advertisement is 
conducted at the server computer. 

3. A method as defined in claim 1, wherein the step of 
inserting data representing the selected advertisement is 
conducted by an Internet service provider. 

4. A method as defined in claim 1, wherein the step of 
inserting data representing the selected advertisement is 
conducted at the client system. 

5. A method as defined in claim 4, further comprising, 
before the step of selecting an advertisement, the step of 
receiving the plurality of advertisements al the client system. 

6. A method as defined in claim 5, further comprising the 
step of storing the plurality of advertisements at the client 
system after the step of receiving the plurality of advertise- 
ments. 
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7. A method as defined in claim 1, wherein the informa- 
tion document is an HTML document. 

8. A method as defined in claim 1, wherein the step of 
compiling the profile includes the step of including in the 
profile user information further characterizing the user, in 
addition to the television programming viewed by the user. 

9. In an information retrieval system including a server 
computer and a client system having a display device, 
wherein the client system has access to television program- 
ming viewed by a user of the information retrieval system, 
a method for inserting an advertisement into a document 
displayed on the display device, the method comprising the 
steps of: 

compiling a profile of the user of the information retrieval 
system at the client system, the profile including at least 
information associated with the television program- 
ming viewed by the user; 

transmitting the profile from the client system to the 
server computer, 

requesting, by the client terminal, an information docu- 
ment from the server computer; 

selecting, by the server computer, an advertisement from 
among a plurality of advertisements for insertion into 
the information document, the advertisement being 
selected based at least in part on the profile and on 
designated selection criteria; 

inserting, by the server computer, data representing the 
selected advertisement into the information document; 

transmitting the information document, including the 
data, to the client system; and 

displaying the information document, including the 
selected advertisement, on the display device. 

10. A method as defined in claim 9, wherein the step of 
compiling the profile comprises the step of identifying 
content of the television programming using an electronic 
television programming database having a content descrip- 
tion corresponding to the television programming. 

11. A method as defined in claim 9, wherein the step of 
compiling the profile comprises the step of identifying 
content of the television programming by monitoring closed 
captioning information associated with the television pro- 
gramming. 

12. A method as defined in claim 9, wherein the step of 
compiling the profile comprises the step of including demo- 
graphic information associated with the user in the profile. 

13. In an information retrieval system including a server 
computer and a client system having a display device, 
wherein the client system has access to television program- 
ming viewed by a user of the information retrieval system, 
a method for displaying information on the display device in 
response to the television programming, the method com- 
prising the steps of: 

monitoring, by the client system, television programming 
viewed by the user of the information retrieval system; 

comparing the television programming viewed by the user 
to a plurality of information categories to identify at 
least one information category that corresponds, 
according to designated selection criteria, with the 
television programming; 



requesting, by the client system, an information document 
classified under the at least one identified information 
category from the server computer; and 

displaying the information document on the display 
device. 

14. A method as defined in claim 13, wherein the infor- 
mation document includes news. 

15. A method as defined in claim 13, wherein the infor- 
mation document includes reference information relating to 
the content of the television programming. 

16. A method as defined in claim 13, further comprising, 
prior to the step of comparing the television programming 
viewed by the user to the plurality of information categories, 
the step of selecting the plurality of information categories 
based in part on user input. 

17. A method as defined in claim 13, further comprising, 
prior to the step of comparing the television programming 
viewed by the user to the plurality of information categories, 
the step of selecting the plurality of information categories 
based at least in part on a profile of the user. 

18. A method as defined in claim 17, wherein the profile 
includes information associated with the television program- 
ming viewed by the user. 

19. A method as defined in claim 13, wherein the step of 
requesting an information document is conducted without 
direct user assistance. 

20. A computer program product for implementing a 
method of displaying an information document including an 
advertisement selected at least in part on television program- 
ming viewed by a user of an information retrieval system, 
wherein the method is implemented in a client system of the 
information retrieval system, the computer program product 
comprising: 

a computer-readable medium carrying computer-execut- 
able instructions for implementing the method, wherein 
the computer-executable instructions comprise: 

program code means for monitoring television pro- 
gramming viewed by the user; 

program code means for compiling a user profile, 
wherein the user profile includes information asso- 
ciated with the television programming viewed by 
the user; 

program code means for requesting an information 
document from a server computer; and 

program code means for displaying the information 
document having the advertisement included therein, 
wherein the advertisement has been selected from a 
plurality of advertisements based at least in part on 
the user profile. 

21. A computer program product as defined in claim 20, 
wherein the computer-executable instructions further com- 
prise program code means for initiating transmission of the 
user profile to the server computer, wherein the advertise- 
ment is selected from the plurality of advertisements at the 
server computer. 

22. A computer program product as defined in claim 20, 
wherein the computer-executable instructions further com- 
prise program code means for initiating transmission of the 
user profile to an Internet service provider, wherein the 
advertisement is selected from the plurality of advertise- 
ments at the Internet service provider. 
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23. A computer program product as defined in claim 20, 
wherein the computer-executable instructions further com- 
prise program code means for selecting the advertisement 
from among the plurality of advertisements at the client 
terminal. 

24. A computer program product as defined in claim 23, 
wherein the computer-executable instructions further com- 
prise program code means for receiving the plurality of 
advertisements from an advertisement source and storing the 
plurality of advertisements at the client system. 

25. A computer program product as defined in claim 23, 
wherein the computer-executable instructions further com- 
prise program code means for inserting data representing the 
selected advertisement into the information document. 

26. A computer program product as defined in claim 20, 
wherein the program code means for monitoring television 
programming comprises program code means for monitor- 
ing an electronic programming database that includes con- 
tent descriptions associated with the television program- 
ming. 

27. A computer program product as defined in claim 20, 
wherein the program code means for monitoring television 
programming comprises program code means for monitor- 
ing closed captioning information associated with the tele- 
vision programming. 

28. A system configured to display an information docu- 
ment including an advertisement selected at least in part on 
television programming viewed by a user of the system, the 
system comprising: 

a home entertainment system for providing the television 
programming viewed by the user, including: 

a television programming feed for delivering the tele- 
vision programming; and 
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a television for displaying the television programming; 
and 

an information retrieval system including: 

means for monitoring the television programming 
viewed by the user; 

means for compiling a user profile, including at least 
information associated with television programming 
viewed by the user; 

means for requesting an information document from a 
server computer; and 

means for displaying the information document having 
the advertisement included therein, wherein the 
advertisement has been selected from a plurality of 
advertisements based at least in part on the user 
profile. 

29. A system as defined in claim 28, wherein the means 
for displaying the information document comprises the 
television of the home entertainment system. 

30. A system as defined in claim 28, wherein the means 
for requesting an information document comprises an Inter- 
net browser. 

31. A system as defined in claim 28, wherein the means 
for monitoring the television programming viewed by the 
user comprises an electronic programming database moni- 
toring unit. 

32. A system as defined in claim 28, wherein the means 
for monitoring the television programming viewed by the 
user comprises a closed captioning monitoring unit. 

* * * * * 
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